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1.  Introduction 


Given  a  texture  field,  what  are  the  more  conspicuous^ 
features  which  help  us  in  recognition  and  discrimination 
among  textures?  This  is  a  fundamental  question  for  which 
there  are  numerous  ad  hoc  suggestions  and  some  conjectures 
but  not  yet  a  universally  accepted  answer.  For  example, 
the  famous  conjecture  of  Julesz  (1962)  says  that  second 
order  probability  distributions  defined  over  a  field  are 
sufficient  for  discrimination.  However  the  recent  work  by 
Gagalowicz  (1981)  seems  to  indicate  that  this  conjecture  is 
incorrect  and  a  different  conjecture  is  made  there  as  to  the 
sufficiency  of  spatial  averages.  We  believe  that  our  ability 

to  perceive  is  much  more  complex  and  consequently  this  paper 

does  not  suggest  any  set  of  statistics  sufficient  for  dis¬ 
crimination  in  general.  On  the  other  hand,  even  though  such 

statistics  are  difficult  to  come  by,  still  it  is  very  prob¬ 

able  that  some  statistics  are  more  useful  than  others  and 
some  are  not  useful  at  all,  being  either  redundant  or  else 
degenerate  in  some  sense,  the  idea  being  that  our  perception 
consumes  or  filters  out  the  "useful”  pictorial  information 
and  leaves  unnoticed  degenerate  or  redundant  information. 
However,  as  our  analysis  of  discrimination  is  carried  out 
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via  mathematical  means  it  probably  yields  necessary  rather 
than  sufficient  conclusions. 

The  purpose  of  this  work  is  to  investigate  the  useful¬ 
ness  of  some  features  termed  higher  order  crossings  in  tex¬ 
ture  discrimination.  Although  we  are  not  sure  as  to  how 
the  human  perception  operates  in  its  fine  and  complex  details 
and  hence  cannot  model  it  precisely,  certain  coarse  observa¬ 
tions  can  nontheless  be  made.  First,  the  visual  system  is 
capable  of  noticing  simple  changes  or  marked  shifts  in  tex¬ 
ture  fields.  For  example,  as  the  intensity  of  grey  levels 
varies  across  a  field,  the  human  observer  is  capable  of  ob¬ 
serving  certain  simple  cyclical  patterns  or  movements  of 
rising  and  falling  intensities  caused  by  clusters  of  like 
grey  levels.  Second,  discrimination  is  done  on  a  qualitative 
basis  in  the  sense  that  recognition  is  done  by  detecting  rela¬ 
tive  changes  of  magnitude  rather  than  by  actual  measurements. 
Third,  texture  is  shift  invariant.  That  is,  our  ability  to 
recognize  a  texture  field  is  not  affected,  or  nearly  so,  by 
rigid  shifts  of  this  field. 

Taking  these  observations  into  account,  it  is  possible 
to  construct  a  crude  discrimination  procedure  as  follows. 

If  {1}  is  our  texture  field,  then  the  shift  invariance  prop¬ 
erty  suggests  that  the  assumption  that  { Z }  is  a  stationary 
random  field  is  reasonable.  The  cyclical  movements  and 
changes  observed  in  a  field  can  in  many  cases  be  detected 
by  a  linear  filter  or  the  successive  application  of  linear 
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filters.  The  qualitative  information  in  a  random  field  can 
very  well  be  detected  by  applying  to  the  filtered  field  the 
nonlinear  clipping  operator.  At  the  final  stage  of  this  pro¬ 
gram  comes  the  construction  of  powerful  discrimination  mea¬ 
sures  in  the  form  of  test  statistics.  If  is  the  i^  filter 
applied  to  the  field  {Z},  U  the  clipping  operator,  and  ip  the 
discrimination  statistic,  our  coarse  scheme  is  symbolically 
represented  by 

<p(U  o  Sk_1  o*"  °  SL  o  SQ{Z}),  k  =  1, 2  , .  .  .  . 

The  crossings  of  level  0  by  o  ...  o  SQ(Z)  are  called  the 

higher  order  crossings  of  order  k.  Obviously  this  informa¬ 
tion  is  qualitative  and  is  retained  by  the  clipped  filtered 
field.  Our  business  then  is  to  investigate  the  usefulness  of 
the  higher  order  crossings  so  defined  in  the  discrimination 
of  texture  fields. 

We  note  from  the  outset  that  apart  from  some  rigorous 
results,  this  work  is  more  of  a  suggestion  for  future  work 
rather  than  a  conclusive  and  finished  work.  In  fact  we 
shall  give  only  one  concrete  example  of  tp  and  even  this  is 
incomplete. 


2 .  The  Effect  of  Clipping  on  Sequential  Linear  Filtering: 
The  One  Dimensional  Case 


Let  be  a  zero  mean  stationary  process  with  spec¬ 

tral  representation 

Zt  =  f  eltXdS(A), 

2 

where  Ejd?(A)|  =  f(A)dA,  f  being  the  spectral  density  func¬ 
tion  of  the  process.  Let  B  be  the  backwards  shift  operator. 


BZt  -  Zt-1 


and  let  U  be  the  clipping  operator. 


uzt  = 


.0, 


z  *  o 

Zt  <  o 


As  a  polynomial  in  B  is  well  defined,  we  shall  be  interested 
in  the  operation 

U  (1-B)m(l+B)n,  (1 

applied  to  (Z^}  for  m,n  =  0,1,2,...,  such  that  m/n  = c  con¬ 
stant.  Observe  that  U  is  insensitive  to  scale  and  that  the 
effect  of  (1)  on  {Z^}  is  equivalently  recorded  by  applying  U 
to 


Y[n)  =  (l-B)cnCl+B)n{Z. /a  } 
t  t  n 

where  a  >  0  is  defined  so  that  Var(Y^.n^)  =  1.  Strictly 
n  t 

speaking  {Y^n^}  depends  on  c  but  this  is  suppresed  for  the 
sake  of  simplified  notation.  Let  the  transfer  function  of 
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(1-B)cn(l+B)n  be  denoted  by  Hn(X),  again  suppressing  c.  Then 
Hn(X)  =  (l-e'lX)cn(l+e"lX)n, 


and  it  follows  that  the  spectral  density  of  {Y^nh  is  given  by 


fn(X)  = 


|Hn(X) J  2f CX) 


L |H- 


-7T  £  X  <  tt  . 


(il>)  I  f  (a>)dw 


We  note  that  the  squared  gain  | H  C X  > | ^  is  symmetric  and 

(i)  |H  (X)|2  =  2cn+n ( 1  -  cos  X )cn(l  +  cos  X)n 

n 

(ii)  For  0  i  X  <  tt  ,  the  squared  gain  is  unimodal  with  a  peak 
occurring  at  X^,  say.  We  have 


max  | H  (X ) j  =  H  (X  ) 
0<X.<it  n  n  c 


where  X  =  cos 
c 


■MM) 


(iii)  For  sufficiently  small  e  >  0 

|  H  (X  -  €  )  |  2 
1  n  c  1 


|H  (X  -e/2) 


0 ,  n 


n  c 


and  the  same  holds  if  a  plus  replaces  the  minus  sign. 


( iv) 


IWI2  ‘  IWVI1' 


Associated  with  f  is  a  soectral  measure  v  (•)  defined  on 
n  n 

(-it, u]  by 
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Jn(A)  =  |  fn(X)dX,  a  c  (-ir,ir], 


a  being  a  Borel  set.  We  first  study  the  limit  of  v  . 

Proposition  1:  Assume  f(X>,  the  spectral  density  of  (Zt) , 

does  not  vanish  at  X  =  X  .  Then 

c 

Vn  *  + 

c  c 

where  Xc  is  given  in  <ii)  above,  and  is  the  unit  point  mass 
at  u. 

Proof :  First  note  that  is  symmetric  on  ( —  it ,  tr  3  .  Now  for 

e  >  0 


Xc-e 


vn[0,Xc-e)  = 


l  |H- 


(X) I *f(X)dX 


J-tr 


(X) ! ^f(x)dx 


Xc-e 

f  i Hn ( A ) 1 2f  C  X ) dX 

Jn  n 


|H  (X) I  f C X ) dX 


Xc-e/2 


X  -e 
c 


JH  (X  -e  )  :  *■  '  -CX)dX 

n  c 

! H  (X  -e/2) ] ^  ;AC 

n  c  [  f(X)dX 

JX  -£/2 
c 


0 ,  n 


/ 
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Similarly 


J\  +e 

vn(Xc+e,u]  <  -x^/2 
r  c 


j  '  |H  (X) | 2f (X)dX 
h  +r  n 


[H  (X) | (X)dX 


lHn(V£)l 

|H_(X  +e/2) | 


f(X)dX 


f(X)dX 


0 ,  n 


By  symmetry  then 


Vn*C*Xc"e’"Xc+e]  U  CXc-£’Xc+£l>  *  1’  n 


_x  +  'sS,  ,  n 
c  c 


Q.E.D. 


Corollary :  converges  in  mean  square  to  a  cosinusoid 

with  frequency  X  . 

Proof :  By  the  above  argument. 


r 


Hn«) 


X  i  ±X 


|Hn(u) 


1 

'f(w)doj  J 


r  l  d£ ( X )  -0,  n  0. 


O.E.D. 


-  •  r  (  n  )  y  00 

j,  define  a  binary  process  iX  /t__eo  by 


x(n)  .  UY£n). 


/ 
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Proposition  2:  Let  j  >  1  and  define 


-  1  -  cos(7r/j  ) 
1  +  COS  C  TT  /  j  ) 


Without  loss  of  generality  let  ic  be  an  odd  positive  integer. 
Then  if  f(X)  does  not  vanish  at  X 

c 

/Y(n)  Y(n)  v(n)  Y(n)  , 

■  ’  t+j  ’xt+2j  ’  *  *  -  ’  t+tcj  ; 


fioio  •••  10 

lo  1  0  1  •••  0  1 


w.  p.  H 
w.  p.  h 


Proof :  From  Proposition  1,  since  the  complex  exponential  is 

bounded,  we  have  for  a  positive  integer  j  as  n  -*■  °° 


Corr(Y^n)  ,  Y< )  =  j  eljXvn(dX) 


because 


T  -ijX_  ijX„ 

-  i(e  C  +  e  w)  =  cos(jXc)  =  -1, 


X  =  cos 
c 


'MM) 


Therefore 


?r(x|n)  i  )  -  1,  n  -  ”, 


and  invoke  stationarity . 


Q  .  E .  D . 


It  is  instructive  to  consider  some  special  cases  of  this 
last  DroDosition. 
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Example  2.1:  For  c  =  1  we  have  as  n  00 

Corr(Y<n)  ,  Y^?)  -  cos  ( j  n/2) 

=0,  j  =  1 

=  -1,  j  =  2 

=0,  j  =  3 

=1,  j  =  4. 

It  follows  that  the  limiting  binary  series  has  the  general 
form 


1-0-1-0-1-0-1-0 

or 

0-1-0-1-0-1-0-1 


where  stands  for  a  single  space  which  may  contain  either 

0  or  1.  In  particular  if  (Z^J  is  Gaussian  the  "empty  space" 
is  independent  of  its  neighbors.  This  procedure  leads  to  the 
following  table  where  an  empty  space  contains  either  0  or  1. 

c  Limiting  form  of  a  finite  series  from  { X ^  ;} 

1111'  •  •  1  w.p.  *5 
0  0  0  0  •  *  •  3  w.p.  4 

1--0--1--0--1--3  w.p.  4 
0  -  -  1  -  -  0 - 1--0--1  w.p.  is 

1-3-1-0-1-3-1-0  w.o.  \ 

0-1-0-1-0  -1-3-1  w.p.  4 

I  0  1  0  1  0  1  0  w.o.  ^ 

01010101  w.p.  h 


0  or 

I 

1/3  |  or 
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In  this  section  we  specialize  the  transformation  (1)  to 
the  case  n  =  0.  As  this  means  that  repeated  differencing  is 
applied  to  {Z^}  this  corresponds  in  the  limit  to  c = “.  So, 
with  a  slight  change  of  notation,  we  consider  the  sequence  of 
binary  processes  (X^  '}  defined  by 

x[k)  =  lj  (l-B)k-1Zt,  t  =  0  ,±1, . . . ,  k  =  1,2,...  . 


Ck ) 

Then  (X^  }  retains  the  axis-crossings  information  of 

{(l-B)  Z^}.  These  axis-crossings  are  referred  to  as  the 

higher  order  crossings  of  order  k,  and  their  number, 
in  a  series  of  length  N  is  given  by 


N-l 

tu  XCxi^?  *  x?>] 


=  2  l  x'KJ  -  2  l  X<k,x'k> 

t  =  l  T  t=2 


cx[k)  +  x!Tk)) 


Proposition  2  suggests  that  the  sequence  NJk  eventually 

increases.  That  this  is  indeed  the  case  under  suitable  con¬ 
ditions  is  due  in  part  to  the  fact  that 


D,  .  >  0,  ..  -  1  with  probability  1, 

K  +  x  ,  W  K  ,  rl 

and  in  part  to  the  sequential  application  of  a  high  pass  fil¬ 
ter.  This  fact  is  most  conveniently  proved  for  the  Gaussian 
case  and  we  shall  do  so.  We  shall  also  determine  the  approxi¬ 
mate  rate  of  increase  in  ^  for  large  k,N. 


/ 
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Proposition  3:  Assume  {Z^}  is  a  zero  mean  Gaussian  stationary 
process  with  correlation  function  f }  and  spectral  density  f 
which  does  not  vanish  at  it.  If  £  |p^|  <  00  then 


limV»  > 

N-m»  N- 1  n-ko  N- 1 


w.p.  1. 


g(x)  =  |  |  sin-1  (~j),  x  >0. 

Then  for  sufficiently  large  N  and  k.  the  rate  of  increase  of 
^ N-l)  is  approximately  determined  by 


-  a:  1  -  g(  0+  )exp[-  r(s)ds] 

N-l  J0  + 


where 


i,  d  t  ~s  ■y 

_ tt  ds  ^s  +  l _ 


Proof :  To  prove  (i)  it  is  sufficient  to  consider  the  case 

r  T  00 

k  =  2 .  Let  p  y  ( 1 )  be  the  first  correlation  of  i  ( 1-B)  t__00  • 

Now  by  stationarity 


1  Px  P, 

O 

1  -  2p2  +  p„  =  p,  1  p. 


(1  -  Po)  >  0, 


and  so 


P2  P1 


Pi  “  PV(1)  = 


1  -  2pT  +  p„ 

- 1 - £  >  o, 

2(1  -  Px) 


or 


P7(l)  <  Pr 
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(This  last  inequality  reconfirms  Proposition  2  for  the  case 
c  =  °°.)  Since  (Z^}  is  Gaussian  with  mean  0 

Pr(Zt  >  0  |  Zt-1  >0)  =  |  +  |sin-1(Pl). 

From  this  and  (2) 

ED1,N  =  (N'1)(7  -  ^  sin-1( p  x ) ) 

ED2,N  =  (n-1)(7  "  |  sin'1(pv(l) )  . 

(Note  that  the  minus  sign  is  correct.)  But  the  arcsine  is 
monotone  increasing  which  implies 


and  in  general 


ED 


2,N 


>  ED 


1,N 


> 


ED 


k,N 


>  ED 


k-1 , N  • 


This,  (2),  and  the  fact  that  the  absolute  summability  of  ip^} 
implies  the  ergodicity  of  {X^K^}  [3  ,  p.  205]  implies  (i). 

To  prove  (ii),  observe  that  the  density  of  (Y^k^}  has  the 

form 

bkl 1  -  e'iXi2k  f(\) 


where  is  a  normalizing  constant.  As  in  this  expression 
f(A)  is  independent  of  k  it  plays  no  role  as  k  increases. 
Thus  for  sufficiently  large  k  if  we  replace  f(X)  by  a  posi¬ 
tive  constant  the  rate  of  convergence  to  0  1  0  1  •••} 

as  k  increases  will  not  be  greatly  affected.  This  means  that 
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the  rate  of  increase  in  ^  for  large  k  is  approximately 

the  same  as  that  for  white  noise.  Therefore  from  (2) 

“  1  • g<k>’  "  =  o,i,2 . 

Now,  formally  replace  k  in  g(k)  by  real  positive  x  and 
note  that  g(x),  x>0,  is  continuous  and  differentiable.  We 

can  now  define 

r(x)  =  -  g'(x)/g(x),  x > 0, 

and  this  is  explicitly  given  in  Cii).  It  follows  that 

g(x)  =  g(0+)exp[-  f  r(s)ds].  Q.E.D. 

*0  + 

It  should  be  noted  that  (ii)  has  been  verified  experi¬ 
mentally  as  well  in  numerous  simulations. 
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4.  A  Two  Dimensional  Higher  Order  Crossings  Theorem 

In  this  section  we  extend  the  notion  of  higher  order 
crossings  to  two  dimensional  stationary  random  fields.  We 
only  deal  with  the  transformation 

U  ( 1-B .  )^(1-B .  )4  Z(t, ,t,)  ( 

T1  t2  1  1 

where  (1-B^  )Z(t^,t2)  =  ZCt^^jt^)  -  Z(t^-l,t2)  and  similarly 

for  (1-B  ).  By  two  dimensional  higher  order  crossings  we 

2 

mean  the  horizontal  and  vertical  symbol  changes  in  the  in¬ 
finite  binary  array  (3). 

Let  {Z(t^,t2),  t-ptj  =  0,±1, .  .  .  }  be  a  stationary  zero 
mean  random  field.  Then  C  3  3  the  field  admits  the  spectral 
representation 

r  i  ( t  j  *  + 1 ,  x  > 

Z(tl,t2)  S  J  2  e  d5(A1,X2),  I  s  (-7T  ,7T  3  , 

where  E  |  dC  ( X  ^  ,  A  2  )  |  =  f  (A  A  2  )dA  ^dA  2  ,  fCX^jA^)  being  the 
spectral  density  of  the  field.  Above  it  was  shown  that  the 
number  of  higher  order  crossings  in  the  one  dimensional  case 
increases  for  long  time  series,  and  also  that  repeated  se¬ 
quential  differencing  and  clipping  yields  realizations  of 
the  form  0  1  0  1  0  1  •••}.  The  extension  of  these  re¬ 

sults  to  two  dimensional  random  fields  is  not  automatic  due 
to  the  geometry  of  two  dimensional  arrays. 

We  shall  now  make  the  last  assertion  precise  via  an  ex¬ 
ample.  For  convenience  we  introduce  the  notation 

V  =  1-B. 
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(JO, 


Define  a  binary  random  field  {X  by 


x(k)(tx,t2)  =  u  vk“1vk'1z(t1,t2) ,  tx,t2  = 0,±1, . . . 


Let  ^  denote  the  number  of  symbol  changes  (higher  order 
crossings)  in  a  finite  two  dimensional  time  series  from 
(X^k  ^  (t^ ,  1 2 )  }  such  that  1«  t-,  SM,  l«t25.N.  Recall  that 
in  the  one  dimensional  case  D^  ^  >  D^_x  M  “  1  proba¬ 

bility  one  and  in  fact  surely!  This  is  due  to  the  geometry 
of  the  series  and  not  to  any  probabilistic  argument.  In  two 
dimensional  arrays  the  geometry  is  more  complex  and  the  number 
of  higher  order  crossings  may  actually  decrease  sharply. 


Example  4.1. 


(a) 


U  Z 


r  * 

1 1 
i 

i  0 

!  i 


1 1 


1,3x3 


=  5 


1-9 

1 

'  1 

1 - 


-11  7 

16  -2 
-10  -5 


1 

l 

I 

I 

< 


rr~o  1] 

Jo  1  0  { 

J  1  0  0  1 

I - 1 


D 


2,3x3 


=  10 


/ 


1 
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(b) 


2 

-4  {  -15  2  4  | 

t2  16  |  -  3  10  5  | 

25  |  4  1  -5  | 

40  ~12  7  0 


7 


t 


2 

2 


i  8  4  7  [ 

!  2  16  1  ! 

3  i 


t 


1 


t 


1 


U  2 


l 


1 

1 


t  o 

'  1  1 

l:  .... 


i  i 

i 

l  i 

0  i 

- A 


Dl,  3x3  =  5 


U  7. 


1  1 
1  1 
1  1 


1  i 

1  I 
I 

1  I 
_ I 


D2,3x3  =  0 


From  the  example  it  is  evident  that  may  either  decrease 

or  increase  with  k.  It  is  seen  that  by  differencing  a  clear 
peak  (trough)  the  number  of  higher  order  crossings  increases 
while  a  crest  or  a  ridge  may  sharply  decrease  this  number  for 
given  M,N.  Thus  we  conclude  that  the  increase  or  decrease  in 
the  is  largely  due  to  the  shape  or  appearance  of  the 

field.  However,  we  shall  show  that  under  appropriate  proba¬ 
bilistic  conditions  the  behavior  of  higher  order  crossings  in 
two  dimensional  fields  mimics  the  one  dimensional  case. 
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Theorem  1.  Let  be  a  non-constant  zero  mean  station¬ 

ary  random  field  with  spectral  density  f(A^,A2)  which  does  not 
vanish  at  (n,ir).  Then 

{U  7^  vj  ZCt^tJ}  -  {a, a'},  k,£+», 

X  L  ^  ~ 

where  means  weak  convergence. 


...101010... 

...010101... 

a=.  .  .101010.  .  .  ,  with  probability  1/2, 
...010101... 

...101010... 


and  a'  is  the  same  array  as  a  shifted  to  the  right  once. 

Proof :  The  proof  is  entirely  analogous  to  the  one  dimensional 
case.  First  let  j  =  min(k,i)  and  define  the  symmetric  kernel 

H(  A  )  =  [  1  -  e"lX  j  2  ,  -it  <  A  <tt. 


From  0  to  it  it  is  monotonically  increasing.  Since  we  are  just 

k  k 

interested  in  knowing  whether  7  7  Z(t. ,t  )  is  above  or  be- 

tl  x2  1  1 

low  0  we  can  normalize  this  process  by  a  positive  quantity 


with  no  loss  of  generality.  Define 
-(k) 


( t  ^ ,  1 2 ) 


pk  ™k  7(t  t  . 

tl  t2^  rr  2 


(Var  7^  V*  Zft/.t,))1* 
Z1  z2  1  1 
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The  corresponding  spectral  density  is 


VxrV 


hk(A1)hk(X2)f(A1,A2) 

7  k  k  ^  ’ 

J  2  h  (w^)h  (<o2 )f (aj^,ca2 Jdoj^dWj 


with  spectral  measure  p(a).  As  in  the  one  dimensional  case 

k 

we  shall  show  that  the  spectral  mass  is  "pushed"  to  the  point 
(7r,ir).  We  have  'tor  e  >0 

/•ir-e 
JI  — TT+S 


P  { C-Tr+e  ,TT~e]  y  T)  <. 
k 


hk(~-e) J  J*  £  hk(A2)f(A1,A2)dA1dA2 
7  r-ir-e/  2  Ttt 

Ci  +  J 

JI  J-ir  V-i 


3hiC(X2)f(A1,X2)dA1dA2 


5  ^  ■  -  0,  k 

h(^-e/2) 


since  h  is  monotone  increasing  on  [0,it].  Similarly 


p{I  x  [— 7T+e  -*■  0,  k  -*• 00 . 

k 


There  are  now  four  corners  left  intact.  Consider  the  first 
near  (it, -it). 

-ir+e  rit 


uCCtt— e  ,tt]  x  (-ir,-Tr+e]}  < 


hk(V)hk(TT) 

h2k(7r)f(7T,TT)(dTr)2 


fir 

1  f CXi.A2)dXidAs 

irr  Jn-e 


-*■  0, 

where  by  "dir"  we  mean  a  sufficiently  small  quantity.  Similarly 
for  the  corners  (-7r,-rr)  and  (-it, it).  It  follows  that 


P 

k 


6  (7T  ,  7T  )  ’  k"*’ 

where  6  ^ ^  ^  is  the  unit  mass  at  (7T,tt). 
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This  implies 

Corr(Z(k)(t1,t2),Z(k)<t1+r1,t2+r2)) 


i(r,  A  ■, +r-A,- )  i7r(r,+r0) 

e  1  1  1  1  n(dX1,dX2)  -  e  12 


(-1) 


rl+r2 


as  k  ■+».  Therefore 

{X^k^  ( ,t2) ,  1  SM,  lStjiNl  -£*  M  N  binary  array  in 

which  each  column  and 
each  row  is  of  the 
f orm  (••■0  10  10  1  •••} 

22 

Mow  consider  ft  =  (0,1)*  ,  the  space  of  all  infinite  binary 
arrays.  In  this  space  we  introduce  the  product  topology  in 
which  a  neighborhood  of  Y  €  ft  has  the  form 

'V/ 

VM(Y)  =  {X  €ft  I  X(t1,t2)  =Y(t1,t2)  if  |t1|  , !  1 2 1  «Ml. 


Then  the  last  statement  means  that  for  each  M, 

Pr((X(k)(t1,t2),t1,t2  =  0  ,  ±  1 ,  .  .  . }  «  VM(a)  UVM(a’))  -  0,  k-» 

It  follows  that  the  probability  law  of  {X  (t^t^)}  converges 
to  a  measure  supported  on  a  and  a'  only: 

UfX(k)})  -  ct<5  +  ( 1-a )6  t,  0<a<l. 

a  3. 

''J 

But  as  this  measure  is  stationary  and  is  invariant  under  the 
shift  which  carries  a  into  a’ ,  a  =  1/2  and  the  proof  is  com- 
plete.  Q.E.D. 
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From  the  proof  it  is  clear  that  this  theorem  can  be 

proved  in  exactly  the  same  way  for  higher  order  random  fields. 

In  particular  we  have  under  some  conditions 

m  .  m  .  . » 

Corr(  n  V*  2(t)  ,  n  V*  Z(t+r))  -  C-l)~  k-*», 

3*1  tj  ~  j  =  l  ti  ~~ 

m  k  k  k 

where  n  =  7.  •••V.  ,  t,r  are  m*l  vectors  of  integers. 

j  =  l  *1  ~~ 

The  one  dimensional  version  of  Theorem  1  has  been  first  proved 
in  [6]  and  referred  to  as  the  higher  order  crossings  theorem. 
We  call  Theorem  1  the  two  dimensional  higher  order  crossings 
theorem. 

Finally,  the  ^  increase  with  k  for  large  M,N.  To 
show  this,  it  is  sufficient  to  consider  only  one  row  in 
{X(k)(t1,t2)},  l<t2<M,  1  -  1 2  S  N,  k  =  1,2,...  .  Let 

Dk(M;t*)  be  the  number  of  symbol  changes  in  row  t*  of 
{X(k)  (t1,t2) } ,  l<t2<N,  lSt^sM.  Then  we  have  for  the 

Gaussian  case 


Proposition  4:  Let  {Z(t^,t2>}  be  a  zero  mean  stationary 
Gaussian  random  field,  with  correlation  function  (p(s,t)}. 


If  £  j  p  ( s ,  t )  |  <  00 ,  and  if  Pyyz<l)  <  p(l)  then 

3  ,  t 

D,  <M,t*)  D.  ,(M,tJ) 

lim  — - —  >  lim  -£—=■ - —  . 


Proof :  Follow  the  proof  of  Proposition  3,  part  (i). 
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5.  Discrimination  by  Higher  Order  Crossings 

Guided  by  our  three  observations  in  the  introduction 
and  by  our  theoretical  results  in  the  preceding  sections  we 
shall  develop  a  discrimination  procedure  based  on  higher 
order  crossings.  In  this  section  we  apply  the  results  of 
Theorem  1  and  Proposition  4. 

Recall  that  the  higher  order  crossings  are  defined  as 
the  axis  crossings  by 

Sk  ...  °  °  Sp{Z}  . 


In  this  section  we  specialize  the  sequential  filter  to 

vk-17k-1z(t  t  ),  k  =  1,2,... 

T1  t2  1  1 


where  (Z(t, ,t»)}  is  a  stationary  texture  field  and  V  V  can 
12  '  ti  t2 

be  thought  of  as  a  convolution  operation  applied  to  the  field 
sequentially.  For  example 

Vt  V„  =  (1-B.  Xl-B  ) 

T1  ' 2  ^1  z2 


is  equivalent  to  the  convolution  operator 


(.1  V 


,2  „2 


and  V*  77.  is  equivalent  to  the  Laplacian  convolution  operator 
tl  t2 


1-2  1 
-2  4  -2 

1-2  1 


f 


i 
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Recall  that  the  higher  order  crossings  are  the  same  as  the 
symbol  changes  in 

{X(k)}  =  U7k'1Vk"1{z} 

tl  t2 

and  that  {D^  ^  counts  the  number  of  symbol  changes  in  the 

binary  array  {X^k  ^  ( t1 , 1 2 ) ,  lit^  :M,  1  <t2  sNl.  We  suggest 

the  use  of  the  { D,  w.,}  as  useful  discrimination  features.  Be- 
k  ,MN 

fore  using  these  features  in  discrimination,  consider  some  ex¬ 
amples  which  display  the  general  behavior  of  these  features 
as  recorded  by  Theorem  1  and  Proposition  4. 

Example  5.1.  Consider  the  stationary  wave  model 

ZCt-jjtj)  =  a[Z(t,-l,t2>  +  Zft^jtj-l)  ]  +  u(t^,t2>, 

u(t^,t2>  normal  white  noise  with  mean  0  and  variance  1  and 
|  a  |  <1/2.  The  (D^  X5xi5^k~l  are  g:'-ven  below  for  various 
values  of  a. 


Xj 

i 

X 

L 

2 

3 

k, 15*15’ 

4  5 

5 

*  *  •  •  • 

7 

9  J-  A 

8 

9 

10 

11 

0.40 

1  111 

229 

282 

305 

315 

326 

333 

340 

348 

348 

360 

0.  25  | 

154 

245 

282 

305 

317 

3  2  6 

333 

340 

352 

350 

360 

0.00 

173 

263 

296 

312 

324 

327 

337 

348 

352 

353 

359 

-0.25 

109 

296 

314 

324 

331 

335 

342 

352 

3  5  3 

361 

364 

-0.40 

255 

326 

333 

342 

342 

353 

355 

361 

36  7 

369 

372 

I 
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Example  5.2.  In  this  example  we  derived  the  higher  order 
crossings  for  texture  fields  obtained  from  stained  paper, 
quartz  and  grass,  where  the  textures  are  coded  as  grey  levels 
ranged  from  0  to  6  3  Cl 3* 


Texture 

Dk 

,15x15 

,  k  = 

=  1,2, 

.  .  .  ,10 

Paper 

43 

207 

270 

316 

323 

322 

328 

32 

7 

334 

336 

Quartz 

70 

227 

296 

324 

336 

343 

349 

36 

1 

362 

367 

Grass 

128 

266 

297 

310 

327 

330 

348 

36 

1 

361 

375 

Both  of  these  examples  portray  vividly  the  results  of  the 
preceding  section  and  in  particular  the  monotone  property  of 
the  {D^}.  It  is  seen  that  for  low  order  k,  different  texture 
fields  give  rise  to  different  (D^) ,  but  that  as  k  increases, 
the  higher  order  crossings  give  redundant  information  which 
results  in  similar  (D^}.  A  closer  look  at  the  (D^.)  reveals 
that  D,  corresponds  to  axis-crossings,  D„  corresponds  to  peaks 

X  X 

and  troughs,  corresponds  to  inflection  points,  etc.  This 
can  be  best  seen  in  the  one  dimensional  case.  Mow,  the  above 
theoretical  and  experimental  results  suggest  that  these  visual 
features  are  more  useful  relative  to  some  features  (for  which 
we  do  not  have  names)  corresponding  to  (D. }  for  large  k.  In 
this  sense  low  order  higher  crossings  contain  discrimination 
information  not  found  in  high  order  higher  crossings.  Thus, 
for  discrimination  purposes  it  is  sufficient  to  consider  { D,^ } 
for  k=l,2,...,8  as  in  most  cases  more  than  80%  of  possible 
symbol  changes  are  already  recorded  by  D  .  Another  important 

o 
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point  is  that  from  the  low  order  {D^}  it  is  possible  to  per¬ 
ceive  a  rough  skeleton  of  the  texture  field. 

The  preceding  argument  suggests  that  the  vector 


~  =  (D1,MN,D2,MN’' * • ,DK,MN) ’ 

K  =  8,  say,  contains  information  useful  for  discrimination. 

We  have  thus  reduced  the  texture  discrimination  problem  to  a 
multivariate  analysis  problem  where  the  vectors  of  observations 
correspond  to  visual  features.  This  notion  will  be  extended 
in  the  following  section. 

Now,  our  next  goal  is  to  construct  a  discrimination  sta¬ 
tistic  from  D.  Based  on  our  experience  in  the  one  dimensional 
case  [5]  we  suggest  here  a  fast  and  useful  statistic.  Define 


j  ,mn 


1  ,MN  5 

Dj ,MN  "  Dj -1 , MN  ’ 
[M(N-l)  +  N(M-l)  ]  -  D 


K-l ,MN 


Clearly 


j=l  A3’MN 


=  M(M-l)  +  M(N-l)  =  n, 


and  for  sufficiently  large  M,N 


A.  >  0. 
j  ,MN 

Let  m.  ....  =  E(A.  ....).  We  form  the  well  known  quadratic  form 
j ,MM  j ,MN 

j=l  “j,MM 
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This  is  by  no  means  the  only  statistic  we  have  in  mind,  but 
its  advantage  is  that  it  takes  into  account  the  monotonicity 
property  of  the  {D^}.  Many  experimental  results  show  that  a 
critical  value  of  65  corresponds  approximately  to  a  0.05  sig¬ 
nificance  level. 


Example  5.3.  The  estimated  m^  15x15  ^or  white  noise  are 


j  =1,2,. ..,9 

,15x15 

210.44  70.39  26.85  15.82  11.61  6.9  5.73  4.03  68.23 

From  Example  5.2  we  have 


Texture 

A  . 
0 

,15x15’ 

0  =  1 

,2,. 

•  •  ,9 

Stained  paper 

43 

164 

63  46 

7 

0 

6 

0 

93 

Quartz 

70 

157 

69  28 

12 

7 

6 

12 

59 

Grass 

I.'.  3 

138 

31  13 

17 

3 

18 

13 

59 

White  noise 

208 

69 

19  26 

14 

18 

3 

7 

56 

Wave  model,  a  =  0 . 4 

111 

113 

53  23 

10 

11 

7 

7 

80 

In  testing  the  hypothesis  that  the  above  textures  are  realiza¬ 
tions  of  white  noise  we  have: 


Texture 

Stained  paper 

<p2  =  133. 22  +  124. 48  +  48. 67  +  .  .  .  +  8. 99  >  65 

Quartz 

<p2  =  93.72  +  106.56  +  66.16  +  ...  +  1.24  >  65 

Grass 

\p2  =  32. 29  +  64. 93  +  0. 64  +  .  .  .  +  1.  24  >  65 

White  noise 

ip2  =  0.03  +  0.03  +  2.29  +  6.55  +  0.49  +17.35 

+  1.  30  +  2.  18  +  2. 19  =  32.  91  <  65 

Wave  model ,  a  =  . 4 

1  ip2  =  46. 93+32.  20  +  25.  46  +  ...  +  2.03  >  65 
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We  see  that  only  in  one  case  we  accepted  the  hypothesis  of 

white  noise  as  we  should.  It  is  also  seen  that  stained  white 

2 

paper  is  far  from  being  white  (noise)....  Thus,  our  ip  per¬ 
forms  rather  well  in  texture  discrimination.  In  the  last 
case  of  the  wave  model  the  power  was  found  to  be  over  90%. 

Many  similar  results  were  obtained  for  the  one  dimensional 

2  . 

case.  The  distribution  problem  of  ip  is  an  open  question 
although  we  know  the  approximate  tail  behavior  via  many  simu¬ 
lations  . 


r 


/ 


A  Suggestion  for  a  General  Procedure  for  Texture  Discrimi¬ 


nation 

The  higher  order  crossings  corresponding  to  the  sequential 
k-1  Jc-1 

filter  V.  Vv.  were  shown  to  be  useful  in  discrimination  of 
tl  t2 

texture  fields.  This  leads  naturally  to  the  examination  of 
the  higher  crossings  by 

( 1-B  )P(1+B+.  )q(l-B+  )r(l+B+.  )SfZ} 

tq  t1  t2  t2 

for  rather  low  order  p,q,r,s.  Denote  the  numbers  of  higher 
crossings  in  an  M*N  field  by 

^pqrs,MN^ 

Then  we  suggest  a  very  general  discrimination  procedure  based 
on  these  quantities: 

~  “  ^p  q  r,s,,HN’  ’  Dp  q  r  s,.,MN^' 

If  D  is  approximately  distributed  as  N(p,V)  then 

(D  -  u) ’V_1(D  -  u) 

"V  'V  A/ 

is  a  reasonable  test  statistic. 
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